|
In statistics, the use of Bayes factors is a Bayesian alternative to classical hypothesis testing. Bayesian model comparison is a method of model selection based on Bayes factors. ==Definition== The posterior probability Pr(''M''|''D'') of a model ''M'' given data ''D'' is given by Bayes' theorem: : The key data-dependent term Pr(''D''|''M'') is a likelihood, and represents the probability that some data are produced under the assumption of this model, ''M''; evaluating it correctly is the key to Bayesian model comparison. Given a model selection problem in which we have to choose between two models, on the basis of observed data ''D'', the plausibility of the two different models ''M''1 and ''M''2, parametrised by model parameter vectors and is assessed by the Bayes factor ''K'' given by : If instead of the Bayes factor integral, the likelihood corresponding to the maximum likelihood estimate of the parameter for each model is used, then the test becomes a classical likelihood-ratio test. Unlike a likelihood-ratio test, this Bayesian model comparison does not depend on any single set of parameters, as it integrates over all parameters in each model (with respect to the respective priors). However, an advantage of the use of Bayes factors is that it automatically, and quite naturally, includes a penalty for including too much model structure. It thus guards against overfitting. For models where an explicit version of the likelihood is not available or too costly to evaluate numerically, approximate Bayesian computation can be used for model selection in a Bayesian framework, with the caveat that approximate-Bayesian estimates of Bayes factors are often biased. Other approaches are: * to treat model comparison as a decision problem, computing the expected value or cost of each model choice; * to use minimum message length (MML). 抄文引用元・出典: フリー百科事典『 ウィキペディア（Wikipedia）』 ■ウィキペディアで「Bayes factor」の詳細全文を読む スポンサード リンク
|